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ABSTRACT 


Three  autonomous  eropping  and  feature  extraction  algorithms  are  examined  that 
can  be  used  for  classification  of  low  probability  of  intercept  radar  modulations  using 
time-frequency  (T-F)  images.  The  first  approach,  Erosion  Dilation  Adaptive  Binarization 
(EDAB),  uses  erosion  and  a  new  adaptive  threshold  binarization  algorithm  embedded 
within  a  recursive  dilation  process  to  determine  the  modulation  energy  centroid  (radar’s 
carrier  frequency)  and  properly  place  a  fixed-width  cropping  window.  The  second 
approach,  Marginal  Erequency  Adaptive  Binarization  (MEAB),  uses  the  marginal 
frequency  distribution  and  the  adaptive  threshold  binarization  algorithm  to  determine  the 
start  and  stop  frequencies  of  the  modulation  energy  to  locate  and  adapt  the  size  of  the 
cropping  window.  The  third  approach.  East  Image  Eiltering,  uses  the  fast  Eourier 
transform  and  a  Gaussian  low-pass  filter  to  isolate  the  modulation  energy.  The 
modulation  is  then  cropped  from  the  original  T-E  image  and  the  adaptive  binarization 
algorithm  is  used  again  to  compute  a  binary  feature  vector  for  input  into  a  classification 
network.  The  binary  feature  vector  allows  the  image  detail  to  be  preserved  without 
overwhelming  the  classification  network  that  follows.  A  multi-layer  perceptron  and  a 
radial  basis  function  network  are  used  for  classification  and  the  results  are  compared. 
Classification  results  for  nine  simulated  radar  modulations  are  shown  to  demonstrate  the 
three  feature-extraction  approaches  and  quantify  the  performance  of  the  algorithms.  It  is 
shown  that  the  best  results  are  obtained  using  the  Choi-Williams  distribution  followed  by 
the  MEAB  algorithm  and  a  multi-layer  perceptron.  This  setup  produced  an  overall 
percent  correct  classification  (Pec)  of  87.2%  for  testing  with  noise  variation  and  77.8% 
for  testing  with  modulation  variation.  In  an  operational  context,  the  ability  to  process  and 
classify  LPI  signals  autonomously  allows  the  operator  in  the  field  to  receive  real-time 
results. 
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I.  INTRODUCTION 

A.  AUTONOMOUS  CLASSIFICATION  OF  LPI  RADAR 

The  low  probability  of  intercept  (LPI)  radar  has  established  itself  as  the  premier 
tactical  radar  in  the  civilian  and  military  spectrum.  Table  1  gives  examples  of  current  LPI 
radars,  their  use,  and  their  manufacturer.  Applications  include  radar  altimeters, 
surveillance,  navigation,  aviation  automatic  landing  systems,  target  acquisition  radars, 
tracking  radars,  and  many  more  systems  that  require  LPI  characteristics. 


Table  1.  Current  LPI  Radar  Systems  Under  Production  [1] 


Developer 

System 

LPI  Use 

NavCom  Defense  Electronics 

AN/APN-232 

Combined  altitude  radar  altimeter 

Honeywell 

HG-9550 

Radar  altimeter 

NAVAIR 

GRA-2000 

Tri-service  radar  altimeter 

Tellumat,  South  Africa 

PA-5429 

Radar  altimeter 

Thompson  CSF 

AHV-2100 

Radar  altimeter 

BAE 

ADI  990 

Radar  altimeter 

Textron  Systems 

TALS 

Precision  approach,  automatic  landing 

Sierra  Nevada 

TALS 

Tactical  automatic  landing  system 

Saab  Bofors 

Pilot 

Surveillance,  navigation 

Signaal 

Scout 

Surveillance,  navigation 

Signaal 

Smart-L 

Surveillance 

Ericsson  Microwave  Systems 

HARD-3D 

Fire  control  and  surveillance 

Ericsson  Microwave  Systems 

Eagle 

Fire  control 

Ericsson  Microwave  Systems 

Pointer 

Air  surveillance  radar 

Pitt  Research  Institute,  Poland 

CRM-100 

Surface  target  detection 

China  Inst.  Of  Elec.  Engineering 

JY-17A 

Battlefield  surveillance  radar 

Raytheon 

MRSR 

T arget  acquisition  and  tracking  radar 

T1 

AN/APS- 147 

Enhanced  search  and  target  designation 

Raytheon 

AN/APQ-181 

Tactical  multimode  fire  control  radar 

Northrop  Grumman 

AN/APG-77 

Multimode  tactical  radar 

Raytheon 

AN/APG-70 

Multimode  tactical  radar 

T1 

LANTIRN 

T  errain  following  radar 

Saab  Dynamics 

RPS-15MR 

Radar  guided  air-to-strrface  mtssile 

BAE 

Speaifish 

T  orpedo  for  littoral  environments 

1 


The  term  LPI  is  that  property  of  radar  that,  because  of  its  lower  power,  wide 
bandwidth,  frequency  variability,  or  other  design  attributes,  make  it  difficult  for  it  to  be 
detected  by  means  of  a  passive  intercept  receiver  [1],  Radars  with  such  capabilities  help 
eliminate  many  of  the  security  vulnerabilities  normally  associated  with  radar 
transmission;  with  LPI  radar,  a  user  can  transmit  a  signal  confidently  knowing  the 
probability  is  low  that  the  transmitted  signal  will  not  be  intercepted  by  a  passive  intercept 
receiver. 


The  common  attributes  that  characterize  LPI  radars  are  [2]: 


•  Low  average  power  continuous  wave  (CW)  radiation  with  a  large  time- 
bandwidth  product. 

•  Radiated  energy  spread  over  a  wide  angular  region,  long  time  interval,  and 
wide  frequency  band. 

•  Ultra-low  side  lobe  transmit  antenna. 

•  Power  management  is  employed  to  radiate  only  when  necessary  to 
measure  target  characteristics  and  at  a  level  that  is  consistent  with  the 
radar  cross  section  of  the  targets  to  be  detected. 

•  Atmospheric  attenuation  shielding  is  sometimes  used  at  high  frequencies 
to  limit  reception  by  an  intercept  receiver  (short  range  emitter). 

The  mathematical  characteristic  that  allows  for  minimal  detection  by  a  passive 
intercept  receiver  is  defined  by  the  ratio  of  the  range  at  which  an  intercept  receiver  on 
board  a  platform  can  detect  the  LPI  radar  to  the  range  at  which  the  platform  can  be 
detected  by  the  LPI  radar  [3].  To  directly  compare  the  radar  detection  range  and  the 
intercept  receiver  detection  range  the  ratio,  a  ,  of  the  two  maximum  detection  ranges  is 
given  as  [1] 


a  = 


R, 


\max 


R. 


(1.1) 


where  is  the  maximum  intercept  receiver  passive  emission  detection  range  and 

R^max  is  maximum  radar  receiver  target  detection  range.  The  variable  a  is  a 


2 


performance  parameter  that  has  been  proposed  to  quantify  the  quality  of  a  LPI  radar  by 
determining  the  likelihood  of  a  LPI  radar  being  detected.  If  a  >  1  the  radar  may  be 
detected  by  an  intercept  receiver  at  a  range  greater  than  the  radar  can  detect  targets.  If  a  = 
I  the  radar  can  detect  targets  at  the  same  range  that  the  intercept  receiver  can  detect  the 
radar  emissions,  and  if  a  <  I  the  radar  can  detect  targets  at  a  further  range  than  the 
intercept  receiver  can  detect  the  radar’s  emissions.  [I,  3,  4]. 

There  are  two  hats  to  wear  when  analyzing  LPI  radars.  The  first  hat  is  that  of  the 
offensive  emitter  operator  that  needs  to  minimize  traces  of  his  presence  for  mission 
completion.  The  other  hat  involves  defensive  tactics  and  the  ability  to  detect  and  classify 
the  presence  of  the  offensive  operator’s  emissions  in  order  to  conduct  counter  operations. 
This  thesis  examines  new  autonomous  detection,  feature  extraction,  and  classification 
techniques  in  order  to  help  the  defensive  operator  counter  the  threat  of  the  offensive  LPI 
operator.  These  techniques  reduce  the  human  operator  burden  to  detect  and  classify  these 
types  of  LPI  emitters. 

B,  PRINCIPAL  CONTRIBUTION 

Autonomously  classifying  LPI  Radar  CW  modulations  is  a  four-step  process. 
Figure  1  illustrates  the  four  signal  processing  steps  that  take  place  at  the  intercept 
receiver.  First,  using  a  mathematical  formula  a  signal  is  generated  that  models  the 
sampled  LPI  radar  modulations.  The  signal  is  detected  using  a  time-frequency 
distribution.  The  time-frequency  image  is  then  processed  in  order  to  extract  a  feature 
vector  containing  the  modulation.  After  the  feature  vector  is  extracted,  a  neural  network 
is  used  to  identify  the  LPI  radar  CW  modulation. 
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Figure  1.  Block  Diagram  of  Intercept  Receiver  Signal  Processing, 


Prior  to  this  thesis,  the  software  responsible  for  proeessing  the  images  of  LPI 
signals  was  programmed  to  know  that  all  of  the  generated  signals  were  coming  in  on  a 
carrier  frequency  of  1  kHz  (4=1  kHz).  Realistically,  signals  are  not  always  generated  at 
1  kHz.  To  simulate  an  environment  that  emulates  real-world  scenarios,  it  was  necessary 
to  generate  a  database  that  consisted  of  signals  that  were  similar  to  what  one  might  find  in 
an  operational  environment.  Three  databases  are  investigated  in  this  thesis.  The  first 
database  consists  of  LPI  signal  modulations  at  a  single  carrier  frequency  of  1  kHz.  A 
second,  more  diverse  database,  was  generated  that  contained  signals  at  two  different 
carrier  frequencies.  A  database  with  multiple  carrier  frequencies  is  more  synonymous  to 
an  actual  operational  environment.  The  third  database  is  the  most  diverse  of  the  three.  It 
contained  signals  at  two  different  carrier  frequencies  with  multiple  SNRs.  Not  only  does 
this  database  better  mimic  the  operational  environment,  but  it  also  tests  the  autonomous 
feature  extraction  algorithms  discussed  in  this  thesis. 

Three  time-frequency  processing  techniques  are  investigated.  The  Wigner-Ville 
distribution,  the  Choi-Williams  distribution,  and  the  Quadrature  Mirror  Filter  Rank 
approach  are  examined  and  the  advantages  and  disadvantages  of  each  are  discussed  and 
compared. 
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Three  autonomous  eropping  and  feature  extraetion  algorithms  were  investigated 
to  extract  the  modulation  energy  from  the  T-F  images.  The  first  algorithm,  Erosion 
Dilation  Adaptive  Binarization  (EDAB),  uses  morphological  operations  along  with  a  new 
adaptive  binarization  process.  The  second  algorithm,  Marginal  Erequency  Adaptive 
Binarization  (MEAB),  uses  a  marginal  frequency  distribution  along  with  the  adaptive 
binarization  process  and  the  third  algorithm.  East  Image  Eiltering,  uses  the  fast  Eourier 
transform  and  a  Gaussian  low  pass  filter  to  crop  the  modulation  energy. 

Neural  Networks  are  the  closest  way  to  simulate  how  the  human  brain  processes 
information.  A  neural  network  is  able  to  learn  its  own  algorithm  for  the  classification  task 
with  actual  samples  of  data  [5].  Neural  networks  are  often  used  to  classify  sets  of  data; 
unknown  information  comes  into  the  neural  network,  and  the  neural  network  is  able  to 
identify  and  classify  the  information.  It  is  able  to  do  this  by  training  on  known  sets  of 
data  and  then  comparing  new  sets  of  data  to  the  known  sets  to  correctly  classify  the  data. 
There  are  many  ways  to  implement  a  neural  network.  The  multi-layer  perceptron  (MLP) 
and  the  radial-basis  function  (RBE)  are  both  investigated  to  test  their  applicability  to 
classify  a  EPI  signal  using  the  feature  vector  from  the  time-frequency  detection  images. 

C.  THESIS  OUTLINE 

This  thesis  is  organized  as  follows: 

Chapter  II  briefly  describes  the  EPI  radar  signals  that  are  used  to  exercise  the 
feature  extraction  and  classification  networks.  Specifically  Erequency  Modulated 
Continuous  Wave  signals  (EMCW),  polyphase  coded  signals  such  as  the  Erank,  PI,  P2, 
P3,  and  P4,  and  poly-time  code  signals  such  as  Tl(n)  and  T2(n)  {n  is  the  number  of  phase 
states)  are  investigated.  Also  investigated  are  Binary  Phase  Shift  Keying  (BPSK)  signals; 
although  not  EPI,  they  provide  a  good  benchmark  since  they  are  also  used  in 
communication  systems  which  are  now  appearing  in  the  radar  spectrum. 

Chapter  III  presents  the  time-frequency  distributions  used  for  detection.  The 
Wigner-Ville  distribution,  Choi-Williams  distribution,  and  Quadrature  Mirror  Eilter  Bank 
approach  are  described. 

Chapter  IV  describes  the  three  autonomous  cropping  and  feature  extraction 
algorithms  used  to  isolate  the  modulation  energy  from  the  EPI  signals.  The  autonomous 
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feature  extraetion  algorithm  uses  morphological  operations  to  extract  the  modulation 
energy  from  the  LPI  signal  and  is  called  the  Erosion-Dilation  Adaptive  Binarization 
(EDAB)  technique.  A  Marginal  Erequency  Adaptive  Binarization  (MEAB)  algorithm  is 
presented  and  the  investigation  of  a  2-D  East  Eourier  Transform  (EET)  technique  for 
fdtering  is  described. 

Chapter  V  describes  the  three  different  databases  that  consist  of  the  many  EPI 
signals  used  to  test  the  different  feature  extraction  algorithms. 

Chapter  VI  investigates  the  two  different  classifiers  used  to  classify  the  EPI 
signals.  A  multi-layer  perceptron  (MEP)  network  and  a  radial-basis  function  (RBE) 
network  are  both  examined. 

Chapter  VII  presents  the  classification  results  and  discusses  the  advantages  and 
disadvantages  of  the  different  algorithms. 

Chapter  VIII  concludes  the  thesis  and  recommends  future  work. 
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II.  LOW  PROBABILITY  OF  INTERCEPT  (LPI)  SIGNAL 

MODULATIONS 


In  this  chapter  nine  LPI  radar  modulations  are  deseribed:  FMCW,  Frank,  PI,  P2, 
P3,  P4,  Tl(n),  T2(n).  Although  not  a  LPI  signal  the  BPSK  modulation  is  also  deseribed. 
These  nine  modulations  are  used  to  test  the  feature  extraction  algorithms  presented  in 
Chapter  IV. 

A,  FREQUENCY  MODULATION  CONTINUOUS  WAVE  (FMCW) 

Frequency  Modulation  Continuous  Wave  (FMCW)  emitters  are  often  associated 
with  LPI  beeause  of  their  ability  to  measure  a  target’s  range  and  rate  without  transmitting 
a  lot  of  power  [6].  Deteetion  of  the  target’s  range  and  range  rate  are  done  by  varying  the 
transmit  frequeney  in  the  time  domain  and  then  measuring  the  frequency  of  the  return 
signal  [1].  FMCW  emitters  are  a  popular  approaeh  to  maintain  stealthy  LPI 
characteristics  and  robustness  against  eleetronic  attack  because  of  the  following: 


•  The  frequeney  modulation  spreads  the  transmitted  energy  over  a  large  modulation 
bandwidth  AF . 

•  Interception  of  the  emitter’s  signal  is  difficult  because  the  power  speetrum  of  the 
FMCW  signal  is  nearly  rectangular  over  the  modulation  bandwidth. 

•  The  transmit  waveform  is  deterministie  and  the  transmit  power  is  low. 

•  FMCW  modulations  are  eompatible  with  solid-state  transmitters  (power 
management). 

•  FMCW  is  easier  to  implement  than  phase  code  modulation. 

The  FMCW  waveform  eonsists  of  two  linear  frequency  modulation  sections  with 
both  positive  and  negative  slopes  [6].  The  transmit  signal  for  the  first  seetion  is  given  by 
[1,7] 


(t)  =  sin  In 


(( 

AF^ 

AF  2I 

fc 

— 

t  + — r 

VV 

2  J 

2^«  J 

(2.1) 
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where  is  the  RF  carrier,  AF  is  the  transmit  modulation  bandwidth,  and  is  the 
modulation  period  with  0<t  <t^.  The  transmit  baseband  signal  for  the  second  section  is 
given  by  [1,  7] 

.  ^  ^  If  ^  AF  2] 

S2(t)  =  a,sm27r  /,+—  t-—t  (2.2) 

_V  ^7 

for  t^<t  <  2t^ .  A  triangular  FMCW  signal  is  shown  in  Figure  2.  Note  that  the  bandwidth 
is  denoted  as  AF  ,  the  carrier  frequency  is  denoted  as  ,  and  the  modulation  period  is 
denoted  as  t  . 

m 


Figure  2,  Triangular  FMCW  LPI  Signal, 


B,  POLYPHASE  CODE  FRANK 

In  1963,  R.L.  Frank  devised  a  polyphase  code  that  is  closely  related  to  the  linear 
frequency  modulation  and  Barker  codes  [1,  6,  8].  Barker  codes  can  not  be  used 
successfully  in  LPI  emitters  because  they  can  easily  be  detected  by  a  frequency  doubling 
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circuit.  They  also  have  high  energy  time  side  lobes.  Frank  codes  are  eharacterized  by 
having  a  perfect  autocorrelation  function  and  minimum  side  lobes  [8]. 

The  Frank  eode  is  derived  from  a  step  approximation  to  a  linear  frequency 
modulation  waveform  using  M  frequency  steps  and  M  samples  per  frequency.  A  code 
length  or  proeessing  gain  (number  of  phase  sub-eodes)  is  given  as  [6] 

N^=M^  (2.3) 


The  phase  of  the  ith  sample  of  the y'th  frequency  is 

M 


(2.4) 


where  i  is  the  number  of  the  sample  in  a  given  frequeney  (/  =  1,  2,  ...,  M)  and  j  is  the 
frequeney  steps  (/  =  1,2,  [6].  The  peak  side  lobe  level  is  given  as 

^  1  ' 


PSL  =  201og 


10 


Mn 


(2.5) 


The  phase  shift  in  radians  and  the  unwrapped  signal  phase  shift  in  radians  versus  the  sub¬ 
code  index  for  phase  change  for  a  Frank  signal  with  M  =  8,  =  64,  f^=\  kFlz, 

(sampling  frequency)  =  7  kHz,  and  cpp  (carrier  cycles  per  subeode)  =  1  is  shown  in 
Figure  3.  Note  that  the  code  change  is  largest  at  the  center  of  the  code  (indicated  by  black 
arrow).  From  (2.5)  the  PSL  of  this  signal  is  -28  dB. 
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Figure  3,  Frank  Phase  Shift  and  Unwrapped  Phase  Shift  (radians)  vs.  Index  for  Phase 

Change, 

C,  POLYPHASE  CODE  PI 

The  polyphase  eodes  are  derived  from  a  linear-frequeney-modulation  waveform 
and  a  step-approximation  to  a  linear  frequeney  modulation  waveform  [1,  9].  The  PI 
signal  and  the  rest  of  the  polyphase  eompression  eodes  (PI,  P2,  P3,  P4)  have  many  useful 
features  sueh  as  low  time  side  lobes  and  the  possibility  of  a  large  number  of  sub-eodes.  A 
reduetion  in  the  size  of  side  lobes  makes  all  of  the  polyphase  eompression  eodes  useful  in 
seenarios  where  LPI  is  needed. 

The  PI  eode  is  derived  by  altering  the  Frank  eode.  The  Frank  eode  groups  have 
the  largest  phase  ehanges  from  eode  element  to  eode  element  in  the  eenter  of  the 
uneompressed  pulse.  The  PI  eode  is  designed  to  be  more  Doppler  tolerant  than  the  Frank 
eode  by  having  the  largest  phase  ehanges  oeeur  at  the  ends  of  the  eode  [10].  The  PI  eode 
is  given  by 

{2j  - 1)][(7  -  1)M  +  (/  - 1)1  (2.6) 
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where  i  is  the  number  of  the  sample  in  a  given  frequeney  (i  =  1,2,  .  is  the  number 

of  the  frequeney  (/  =  1,  2,  M)  resulting  in  M  frequeney  steps  and  M  samples  per 
frequeney.  The  proeessing  gain,  ,  is  the  number  of  phase  eodes 

N^=M^  (2.7) 

where  M=  1,2,3...  [1,9].  The  peak  side  lobe  level  is  also  given  by 

PSL  =  20log,,il/M7r)  (2.8) 

The  phase  shift  and  unwrapped  phase  shift  for  a  PI  signal  with  M  =  8,  =  64,  X  =  1 

kHz,  =1  kHz,  and  cpp  =  1  is  shown  in  Figure  4.  The  eode  ehange  is  largest  for  the  PI 
signal  at  the  ends  of  the  eode  (indieated  by  blaek  arrows). 


Figure  4,  PI  Phase  Shift  and  Unwrapped  Phase  Shift  (radians)  vs.  Index  for  Phase 

Change, 
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D.  POLYPHASE  CODE  P2 


The  P2  code  has  the  same  phase  increments  within  each  phase  group  as  the  PI, 
except  that  the  starting  phases  are  different  [10].  The  P2  code  is  given  by  [1] 

=^[2i-l-M][27-l-M]  (2.9) 

where  /  =  MJ  =  1 ,  2,  3 ...  M,  and  is  the  number  of  phase  codes 

N^=M^  (2.10) 

where  A^=l,2,3....  The  peak  side  lobe  level  is  given  by 

P5T  =  201ogio(l/M;z-)  (2.11) 

The  phase  shift  and  unwrapped  phase  shift  for  a  P2  signal  with  M  =  S,  =  64,  =  l 

kHz,  =1  kHz,  and  cpp  =  1  is  shown  in  Figure  5.  The  code  change  is  largest  for  the  P2 
signal  at  the  ends  of  the  code  (indicated  by  black  arrows). 


Figure  5,  P2  Phase  Shift  and  Unwrapped  Phase  Shift  (radians)  vs.  Index  for  Phase 

Change, 
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E.  POLYPHASE  CODE  P3 

The  P3  code  is  conceptually  derived  by  converting  a  linear  frequency  modulation 
waveform  to  baseband  by  using  a  synchronous  oscillator  on  one  end  of  the  frequency 
sweep  (single  sideband  detection)  and  sampling  the  /  and  Q  video  at  the  Nyquist  rate.  The 

first  sample  of  /  and  Q  is  taken  at  the  leading  edge  of  the  waveform  [1,  10].  The  phase  of 

the  ith  sample  of  the  P3  code  is  given  by  [1] 

4=^(i-l)-  (2.13) 

where  i  =  1,2,  ...,Nc,  and  phase  codes  are  present.  The  peak  side  lobe  level  is  given 
as 

PSL  =  20log,,i^2/{Ny))  (2.14) 

The  phase  shift  and  unwrapped  phase  shift  for  a  pulse-compression  waveform  (P3  signal) 
with  M  =  S,  =  64,  X  =  1  kHz,  f,=7  kHz,  and  cpp  =  1  is  shown  in  Figure  6.  The 

code  change  is  largest  for  the  P3  signal  at  the  middle  of  the  code  (indicated  by  a  black 
arrow).  From  (2.14),  the  PSL  is  -24.9  dB. 


Figure  6,  P3  Phase  Shift  and  Unwrapped  Phase  Shift  (radians)  vs.  Index  for  Phase 

Change, 
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F.  POLYPHASE  CODE  P4 

The  P4  code  is  conceptually  derived  from  the  same  linear  frequency  modulation 
waveform  as  the  P3  code  except  that  the  local  oscillator  frequency  is  offset  in  the  /  and  Q 
detectors,  resulting  in  double  sideband  detection  [1].  The  phase  sequence  of  the  P4  signal 
is  described  by  [6] 

(2.15) 

where  k=  1,  2,  3,  ...,Nc,  and  Nc  phase  codes  are  present.  The  peak  side  lobe  level  is  also 
given  by 

PSL  =  20\og,, (^2 /(N^)  (2.16) 

The  phase  shift  and  unwrapped  phase  shift  for  a  P4  signal  with  M  =  S,  =  64,  f^  =  l 
kHz,  =1  kHz,  and  cpp  =  1  is  shown  in  Figure  7.  The  code  change  is  largest  for  the  P4 
signal  at  the  ends  of  the  code  (indicated  by  black  arrows). 


Figure  7,  P4  Phase  Shift  and  Unwrapped  Phase  Shift  (radians)  vs.  Index  for  Phase 

Change. 
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G.  POLYTIME  CODE  Tl(«) 

Polytime  codes  arise  naturally  from  quantizing  the  accumulated  phase  of  a 
stepped-RF  waveform  into  a  fixed  number  of  evenly  spaced  phase  states  and  requiring 
that  no  phase  state  be  skipped  in  the  process  of  encoding  the  underlying  waveform;  the 
Tl(n)  polytime  sequence  is  generated  with  a  stepped-RF  waveform  that  is  zero  beat  at  the 
leading  segment  [2,  11],  In  reference  to  polytime  codes,  n  is  the  number  of  phase  states 
used  to  approximate  the  underlying  waveform  [1,6]. 

The  equation  for  the  wrapped  phase,  versus  time  for  the  Tl(2)  polytime 
sequence  is  [1,  2] 

^(0  =  MOd|— INT[kt-7T],2;z-|  (2.17) 

where 7  =  0,  1,2,  ...,  k-l  is  the  segment  number  in  the  stepped  frequency  waveform  (RF 
waveform),  k  is  the  number  of  segments  in  the  Tl(2)  code  sequence,  t  is  time,  T  is  the 
overall  code  duration,  and  n  is  the  number  of  phase  states  in  the  code  sequence.  The 
phase  shift  for  a  polytime  code  (Tl(2)  signal)  with  X  =  1  kHz,  f,=l  kHz  is  shown  in 

Figure  8  and  in  Figure  9  the  amplitude  of  the  phase  modulated  carrier  signal  is  shown 
against  the  corresponding  time  index. 
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Amplitude  Phase  Shift  -  Theta 


3.5 


Figure  8,  Tl(2)  Phase  Shift  (rad)  vs.  Index  for  Phase  Change, 
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H.  POLYTIME  CODE  T2(«) 

The  T2(2)  sequence  is  generated  by  approximating  a  stepped  frequency  waveform 
that  is  zero  beat  at  the  center  frequency.  If  the  stepped  RF  frequency  has  an  odd  number 
of  elements,  the  zero  beat  frequency  is  the  frequency  of  the  center  segment.  If  an  even 
number  of  segments  are  used,  the  zero  frequency  is  the  frequency  halfway  between  the 
two  centermost  segments.  The  expression  for  the  wrapped  phase  versus  time  for  the 
T2(2)  polytime  sequence  is  [1] 


(p{t)  =  MOD 


|— INT 


{kt-jT) 


V  T  y 


(2.18) 


where)  =  0,  1,2,  is  the  segment  number  in  the  stepped  frequency  waveform  (RF 

waveform),  k  is  the  number  of  segments  in  the  T2(2)  code  sequence,  t  is  time,  T  is  the 
overall  code  duration,  and  n  is  the  number  of  phase  states  in  the  code  sequence.  The 
phase  shift  for  a  polytime  code  (T2(2)  signal)  with  /^  =  1  kHz,  f,  =1  kHz  is  shown  in 

Figure  10  and  in  Figure  11  the  amplitude  of  the  phase  modulated  carrier  signal  is  shown 
against  the  corresponding  time  index. 
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Phase  Shift  -  Theta 


i  -  index  for  phase  change 


Figure  10,  T2(2)  Phase  Shift  (rad)  vs.  Index  for  Phase  Change, 


Figure  11,  T2(2)  Amplitude  vs.  Index  for  Phase  Change, 
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I,  BINARY  PHASE  SHIFT  KEYING  (BPSK) 

In  1953,  R.  H.  Barker  presented  binary  sequenees  for  synehronization  purposes  in 
teleeommunieations  [1,  12],  It  is  important  to  not  eonfuse  Barker  eodes  as  LPI.  Barker 
eodes  are  not  LPI  beeause  they  are  easily  deteeted  by  an  intereept  reeeiver  that  uses 
frequeney  doubling  [1],  Intereept  reeeivers  are  also  able  to  deteet  the  large  side  lobes 
present  in  Barker  eodes.  Barker  eodes  result  in  a  periodie  ambiguity  funetion  with  side 
lobe  levels  not  higher  than  201ogio(l/Ac)  dB  relative  to  a  main  lobe  level  of  1  [1].  LPI 
signals  are  eharaeterized  by  their  small  side  lobes  whieh  prevent  deteetion  and  reduee 
vulnerability  to  jamming.  Barker  eodes  are  an  important  phase  modulation  teehnique  that 
ean  be  used  to  quantify  the  feature  extraetion  and  elassifieation  teehniques  presented  in 
this  thesis  [1,6].  Table  2  eontains  nine  Barker  eodes  with  eorresponding  PSL  and  ISL  [1]. 


Table  2,  Nine  Barker  Codes  with  Corresponding  PSL  and  ISL 


Code 

PSL 

ISL 

Length 

Code  Elements 

(dB) 

(dB) 

2 

-+ -  + 

-6.0 

-3.0 

3 

+  +- 

-9.5 

-6.5 

4 

++-  + 

-12.0 

-6.0 

4 

+++- 

-12.0 

-6.0 

5 

+  +  +-  + 

-14.0 

-8.0 

7 

+++-+- 

-16.9 

-9.1 

11 

+++ - +-+- 

-20.8 

-10.8 

13 

+  +  +  ++-++-+-+ 

-22.3 

-11.5 

In  the  next  ehapter  the  time-frequeney  distributions  used  to  deteet  the  nine  LPI 
radar  modulations  are  presented.  The  time-frequeney  distributions  are  the  Choi-Williams 
distribution,  the  Wigner-Ville  distribution,  and  the  Quadrature  Mirror  Filter  Bank 
approaeh. 
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III.  TIME  FREQUENCY  DISTRIBUTIONS 


In  this  chapter,  three  time-frequeney  analysis  teehniques  are  presented:  Wigner- 
Ville  distribution,  Choi- Williams  distribution,  and  the  Quadrature  Mirror  Filter  Rank. 

A,  WIGNER-VILLE  DISTRIBUTION 

The  Wigner-Ville  distribution  has  been  applied  in  many  areas  of  engineering  to 
include  optical  implementations,  medical  applications,  image  analysis,  target  deteetion, 
and  the  analysis  of  nonstationary  LPI  signals  [1].  The  Wigner-Ville  distribution  is  a 
powerful  time-frequency  analysis  technique  for  signal  processing,  however,  it  does  have 
drawbaeks  like  interfering  eross-terms  between  every  pair  of  signal  frequencies. 

The  implementation  of  the  Wigner-Ville  distribution  used  in  this  thesis  was  from 
[1,  2,  13].  The  Wigner-Ville  distribution  of  a  eontinuous  one-dimensional  funetion  x{t) 
is  defined  as 

00 

W  (t,(i))=  \  x{t  +  —)x*{t-—)e^^"’‘dT  (3.1) 

•'2  2 

-00 

where  t  is  the  time  variable,  (o  is  the  angular  frequency  variable,  and  the  *  indicates  the 
eomplex  eonjugate.  The  Wigner-Ville  distribution  is  a  two-dimensional  funetion 
deseribing  the  frequeney  eontent  of  a  signal  as  a  funetion  of  time  [14]. 

The  eontinuous  time  and  frequency  representation  ean  be  modified  for  a  diserete 
sequence  to  achieve  real-time  evaluation.  The  diserete  Wigner-Ville  distribution  is 
aehieved  by  applying  the  eontinuous  one-dimensional  form  of  the  distribution  to  a 
sampled  time  series  x{l) ,  where  /  is  a  diserete  time  index  from  -  oo  to  oo .  The  discrete 
Wigner-Ville  distribution  is  defined  as 

00 

IT(/,  ni)  =  2  ^  x’  (/  +  n)x  (/  -  (3 .2) 

n=-co 

windowing  the  data  results  in  the  pseudo-Wigner-Ville  distribution  gives 

N-l 

JV(l,a))  =  2  ^  x^{l  +  n)x*{l-n)a>{n)a>{-n)e^^^‘“''  (3.3) 

n=-V+l 
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where  co{n)  is  a  length  of  2N real  window  function  with  ®(0)=1.  Using  /,(n)to 
represent  the  kernel  function 

fj{n)  =  x{l  +  n)x*  (/  -  n)(jo{n)(jo{-n)  (3 .4) 


the  pseudo-Wigner-Ville  distribution  becomes 

W {1,(0}  =  2  X  (3.5) 

H=-Ar+1 
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Figure  12,  Wigner-Ville  Distribution  for  a  7Vc=  64  Frank  Signal, 

Figure  12  shows  the  pseudo  Wigner-Ville  distribution  for  a  V^=  64  subcode  Frank 


signal.  Note  the  strong  presence  of  cross-terms.  Also  note  that  the  bandwidth,  B,  the 
carrier  frequency,  ,  and  the  code  period,  T,  can  easily  be  measured. 


B,  CHOI-WILLIAMS 

The  Choi- Williams  distribution  simultaneously  gives  the  representation  of  a 
signal  in  both  time  and  frequency.  It  has  been  noted  as  one  of  the  more  useful  in  the 
Cohen’s  class  of  distributions  since  it  reduces  the  amplitude  of  the  cross-terms  [6].  It  is 
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hypothesized  that  redueing  the  eross-terms  of  the  distribution  results  in  better 
elassifieation  results d  The  Choi- Williams  distribution  is  given  as  [15] 

Ch,0)=JJJ  f{^,T)x{s  +  T ! 2)x  {s -T ! d^dsdz  (3-6) 


where 


/(4^,r)  =  exp 


2a 


(3.7) 


is  a  Gaussian  parameterization  funetion  that  eontrols  the  eross-terms  and  frequeney 
resolution  in  the  T-F  image  by  varying  cr.  The  redueed  eross-terms  are  one  of  the 
advantages  of  using  the  Choi-Williams  distribution  over  the  Wigner-Ville  distribution. 
Note  that  if  the  parameterization  funetion  is  set  to  1,  =  the  result  is  the  Wigner- 

Ville  distribution. 


Figure  13,  Choi-Williams  Distribution  for  a  7Vc=  64  Frank  Signal, 

Figure  13  shows  the  Choi-Williams  distribution  for  a  =  64  subeode  Frank  signal. 

Note  the  minimal  eross-terms.  Also  note  that  the  bandwidth,  B,  the  earrier  frequeney,  , 
and  the  eode  period,  T,  ean  be  easily  measured. 


1  In  Chapter  VIII,  classification  results  are  presented  and  this  hypothesis  is  investigated. 
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C.  QUADRATURE  MIRROR  FILTER  BANK  (QMFB)  TREE 

The  Quadrature  Mirror  Filter  Bank  (QMFB)  approaeh  enables  signal  proeessing 
of  LPI  signals  without  having  to  take  into  eonsideration  the  effeets  of  eross-terms.  In 
distributions  like  the  Wigner-Ville  and  Choi-Williams  the  presenee  of  eross-terms  makes 
the  image  noisy,  whieh  ean  sometimes  give  misleading  results  [1]. 

A  QMFB  tree  is  shown  in  Figure  14  and  eonsists  of  a  number  of  layers  of  fully 
eonneeted  pairs  of  orthogonal  wavelet  filters  (or  basis  funetions)  that  linearly  deeompose 
the  reeeived  waveform  into  tiles  on  the  time-frequeney  plane.  By  varying  the  wavelet  size 
duration,  resolution  in  time  ean  be  traded  for  resolution  in  frequeney  [2],  The  frequeney 
resolution  of  a  QMFB  layer  /  is 


A/  = 


fs 

2(2' -1) 


(3.8) 


where  is  the  sampling  frequeney.  The  resolution  in  time  is  determined  by  how  many 
samples  are  used  within  the  QMFB  and  is 


At  = 


2^ 


(3.9) 


where  L  is  the  total  number  of  layers. 
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Layer  1 


Layer  2 


Layer  3 


nine  Time  lime  lime 


Figure  14.  Quadrature  Mirror  Filter  Bank  (QMFB)  Tree  [1]. 


Figure  15  shows  the  QMFB  distribution  for  layer  5  for  a  64  Frank  signal  with  cpp  = 
1,  r=  64  ms,  and  B  =  \  kHz.  Note  that  the  bandwidth,  B,  the  earner  frequeney,  /^,  and 
the  eode  period,  T,  ean  be  easily  measured.  From  (3.8  and  3.9)  At  =  .005s  and  A/'  =  112 
Hz  for  this  layer  and  represents  a  good  trade-off  in  time-frequeney  resolution. 
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Figure  15,  QMFB  Layer  5  for  a  7Vc=64  Frank  Signal 


In  the  next  chapter,  three  feature-extraction  algorithms  are  presented.  These 
feature-extraction  algorithms  are  applied  to  the  nine  LPI  signals  discussed  in  Chapter  II 
from  the  three  distributions  discussed  in  this  chapter. 
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IV.  AUTONOMOUS  CROPPING  AND  FEATURE  EXTRACTION 


In  this  chapter,  the  three  autonomous  eropping  and  feature  extraetion  algorithms 
are  presented.  The  first  algorithm  is  the  Erosion  Dilation  Adaptive  Binarization  (EDAB) 
proeess  and  involves  a  combination  of  two  morphological  operations  (erosion  and 
dilation)  to  isolate  the  modulation  [16].  The  seeond  approaeh  is  called  the  Marginal 
Erequency  Adaptive  Binarization  (MEAB)  and  uses  the  marginal  frequeney  distribution 
to  isolate  the  modulation  [17].  The  third  approaeh  uses  Eourier  and  inverse  Eourier 
transforms  and  Gaussian  low-pass  filters  for  modulation  isolation  [18]. 

A,  EROSION  DILATION  ADAPTIVE  BINARIZATION  (EDAB) 

A  bloek  diagram  of  the  EDAB  autonomous  eropping  and  feature  extraetion  image 
proeessing  algorithm  is  shown  in  Eigure  16.  The  EPI  signal  being  shown  to  demonstrate 
the  EDAB  algorithm  is  the  Tl(2)  shown  in  Eigure  9.  The  first  step  of  the  algorithm  is  to 
remove  the  signal’s  no-signal  region  if  it  has  one.  A  no-signal  region  in  a  EPI  signal 
oeeurs  if  the  duration  of  the  EPI  signal  is  smaller  than  the  time  interval  proeessed.  Sinee 
the  no-signal  region  within  the  T-E  image  does  not  contain  useful  information  for 
classifieation,  this  region  is  removed.  The  Tl(2)  signal  with  its  no-signal  region  removed 
is  shown  in  Eigure  16.  The  image  labeled  as  C(t,co)  is  the  EPI  signal  with  the  no-signal 
region  present  and  the  image  labeled  as  C  '(t,  co)  is  the  same  EPI  signal  with  the  no-signal 
region  removed.  Before  the  feature  extraction  processing,  the  image  was  resized  (redueed 
by  0.1)  using  nearest  neighbor  interpolation  in  order  to  inerease  the  proeessing  speed  (see 
Eigure  16,  No.l). 
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Time  (s) 


Figure  16, 


New  Autonomous  Feature  Extraction  Algorithm, 


1,  Erosion  and  Dilation  Processing 

Dilation  and  erosion  are  two  funetions  that  are  fundamental  to  morphological 
operations  [2].  In  morphological  dilation  and  erosion  operations,  the  state  of  any  given 
pixel  in  the  output  image  is  determined  by  applying  a  rule  to  the  corresponding  pixel  and 
its  neighbors  (within  a  defined  structuring  element)  in  the  input  image  [19].  The  rule  used 
to  process  the  pixels  defines  the  operation.  For  dilation,  the  output  pixel  is  the  maximum 
value  of  all  the  pixels  in  the  input  pixel’s  neighborhood.  The  dilation  of  image  A  by 
structuring  element  B,  denoted  A®  B  ,  is  defined  as  [2] 

A®B  =  {Z\{B)^r^A^<Z)]  (4.1) 


where  the  dilation  of  ^4  by  5  is  the  set  Z  consisting  of  all  the  structuring  element  origin 
locations  where  the  reflected  and  translated  B  overlaps  at  some  portion  of  A  is  not  the 
empty  set  0  [18].  In  terms  of  erosions  and  dilations  the  type  of  structuring  element  used 
depends  on  the  need  of  the  user. 
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Figure  17.  Sample  Dilation, 

Figure  17  demonstrates  the  dilation  concept  using  a  cross  structuring  element. 
When  structuring  element  B  is  convolved  with  image  A  the  resulting  image  is  Z  where  the 
original  pixels  of  the  image  are  shaded  in  grey  and  those  that  are  not  shaded  in  grey  are  a 
result  of  the  dilation.  When  the  result  of  the  AND  operation  between  the  reference  pixel 
of  the  structuring  element  and  the  image  Z  is  1  the  pixels  of  the  image  are  expanded  to 
the  shape  of  the  structuring  element. 

For  erosion,  the  value  of  the  output  pixel  is  the  minimum  value  of  all  the  pixels  in 
the  input  pixel’s  neighborhood.  The  erosion  of  image  A  by  structuring  element  B,  denoted 

A  B,  is  defined  as  [2] 

A  B={z\(B)^nA^  ^0]  (4.2) 

where  the  erosion  of  image  A  by  structuring  element  B  is  the  set  Z  of  all  structuring 
element  origin  locations  where  the  translated  B  has  no  overlap  with  the  background  A  and 
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is  not  the  empty  set  0  [18].  Figure  18  demonstrates  the  erosion  concept  using  a  cross 
structuring  element. 
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Figure  18,  Sample  Erosion, 

When  structuring  element  B  is  convolved  with  Image  A  the  resulting  image  is  Z 
where  the  original  pixels  of  the  image  are  shaded  in  grey.  When  the  result  of  the  AND 
operation  between  the  reference  pixel  of  the  structuring  element  and  the  image  is  1,  the 
pixels  of  the  image  are  deleted  to  the  shape  of  the  structuring  element  and  only  the  pixel 
in  Image  A  that  is  in  the  location  that  corresponds  with  the  reference  pixel  of  the 
structuring  element  remains  a  1 . 

The  first  erosion  operation  in  the  EDAB  algorithm  uses  a  diamond  structuring 
element  with  radius  2.  Table  3  presents  the  different  structuring  elements  used  in  the 
EDAB  algorithm  and  a  description  of  why  that  particular  structuring  element  was  chosen. 
Each  structuring  element  is  chosen  strategically  to  accomplish  a  certain  morphological 
task.  The  first  erosion  serves  to  detect  the  signal  modulation  and  eliminate  any  noise 
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present  in  the  image.  This  proeess  is  shown  in  more  detail  in  Figure  19.  The  erosion 
output  clearly  detects  the  Tl(2)  modulation  in  this  example.  The  erosion  operation  is 
followed  by  a  dilation  operation  (disk  structuring  element  with  radius  5)  to  enhance  the 
detected  modulation  features  within  the  image  (see  Figure  16,  No.  3). 

Table  3,  Structuring  Elements  Used  in  EDAB  Algorithm 

Structuring  Element  Description 

The  diamond  structuring  element  is  used  to 
eliminate  noise 


Disk 

The  disk  structuring  element  is  used  to  highlight 
the  modulation  energy 


The  line  structuring  element  is  used  to  expand 
the  extracted  modulation  features  across  the 
time  axis  (horizontal  axis)  until  there  is  a 
continuous  line  that  runs  across  the  length  of 
the  image 


Line 


Diamond 
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Time  (s) 

(a)  (b) 

Figure  19,  Modulation  Detection  Process  Showing  the  (a)  Resized  Image  and  (h) 

Erosion  Output, 

The  erosion  and  dilation  are  followed  by  a  recursive  dilation  operation  (line 
structure  with  length  /)  [20].  The  recursive  dilation  operation  expands  the  extracted 
modulation  features  along  the  time  axis  (pixels  aligned  horizontally)  until  a  continuous 
strip  results.  The  increment  /  is  used  to  control  the  length  of  the  horizontal  structuring 
element  to  ensure  that  the  output  of  the  dilation  is  an  image  with  a  continuous  horizontal 
line  that  runs  the  length  of  the  entire  image.  The  initial  length  is  set  to  0  and  incremented 
as  /  =  /  +  !.  The  dilation  output  results  are  shown  in  Figure  20(a).  Embedding  the  dilation 
operation  in  a  feedback  loop  about  an  adaptive  threshold  binarization  process  then  allows 
the  detection  of  the  modulation  energy  center  as  shown  in  Figure  20(b). 
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Time  (s) 

(a)  (b) 


Figure  20,  Energy  Center  Detection  Showing  (a)  Dilation  Output  and  (b) 

Modulation  Energy  Center  Detected, 

2,  Adaptive  Threshold  Binarization  Processing 

A  block  diagram  of  the  adaptive  threshold  binarization  process  is  shown  in  Figure 
21.  The  intensity  image  |  I{t,co)  \  is  normalized /'(t,®)  with  respect  to  the  largest  value  in 
the  image,  where  the  pixel  values  0  <  /  \t,  o)  <  1 . 

/(4ty) 


Figure  21,  Adaptive  Threshold  Binarization  Process, 
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A  histogram  of  the  intensity  level  eontent,  h{n),  is  then  generated  using  N  =  50 
bins.  The  eumulative  distribution  funetion  is  eomputed  using  this  histogram  as 

th(i) 

cdf{n)  =  ^ -  (4.3) 

^hin) 

n=l 

A  cdf  threshold,  C,  is  chosen  and  the  intensity  bin  n  where  cdf(n)  >  C  is  then  identified. 
For  example,  if  the  cdf  threshold  is  chosen  experimentally  to  be  C  =  0.8,  this  means  that 
only  20%  of  the  brightest  pixels  above  the  threshold  are  retained.  With  this  intensity  bin, 
a  corresponding  normalized  intensity  threshold,  T  =  n/N,  is  calculated.  This  threshold  is 
then  used  to  convert  the  intensity  image  into  a  binary  image.  That  is, 

=  (4.4) 

[O  (white)  I'd,  a>)<T 

which  effectively  removes  much  of  the  noise  and  weak  interference. 

3.  Autonomous  Cropping  and  Final  Image  Resize 

After  the  signal  modulation  energy  center  is  identified,  the  information  is  used  to 
autonomously  crop  the  modulation  pixels  from  the  original  image  C'(f,(»)  (shown  in 
Figurel6)  to  form  the  image  shown  in  Figure  22(b). 
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Titne  (s) 

(a)  (b) 

Figure  22.  Autonomous  Cropping  Showing  (a)  Original  Resized  Image  and  (b) 

Cropped  Image, 

The  adaptive  threshold  binarization  algorithm  is  used  again  to  generate  a  binary 
feature  image.  Since  the  information  is  binary,  the  image  is  resized  to  N\xN'^  by  low 

pass  filtering,  resampling  and  then  applying  a  bilinear  interpolation.  The  low  pass  filter  is 
used  to  reduce  the  effect  of  Moire  ’  patterns  and  ripple  patterns  that  result  from  aliasing 
during  the  resampling  operation  [21].  The  N\xN\  image  is  then  converted  into  a 

feature  vector  of  size  for  processing  by  a  multi-layer  perceptron 

classification  network  where  N\  =N\  =  50 . 

B,  MARGINAL  FREQUENCY  ADAPTIVE  BINARIZATION  (MFAB) 

A  block  diagram  of  the  autonomous  feature  extraction  image  processing  is  shown 
in  Figure  23.  The  LPf  signal  shown  to  demonstrate  the  MFAB  algorithm  is  the  Tl(2). 
Since  the  no-signal  region  within  the  T-F  image  does  not  contain  useful  information  for 
classification,  this  region  is  removed.  An  LPf  signal  (Tl(2))  with  its  no-signal  region 
removed  is  shown  in  Figure  24. 
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Figure  23.  Autonomous  Preprocessing  to  Isolate  Signal  Modulation 


(a)  (b) 

Figure  24.  T-F  Image  Showing  (a)  No-Signal  Region  and  (b)  the  Same  Image 

with  No-Signal  Region  Extracted. 

1.  Marginal  Frequency  Distribution 

The  marginal  frequency  distribution  offers  one  way  to  examine  a  T-F  image  in 
cases  where  there  is  a  low  SNR  [22],  The  marginal  frequency  distribution  gives  the 
instantaneous  energy  of  the  signal  as  a  function  of  frequency.  LPI  signals  have  a  low 
SNR  and  that  is  why  using  a  marginal  frequency  distribution  for  analysis  produces 
optimum  results.  The  marginal  frequency  distribution  is  generated  by 
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C(o)  =  j  C{t,(o)dt 


(4.5) 


or  summing  the  time  values  for  each  frequency  in  the  T-F  image  and  then  storing  the 
sums  in  an  array.  Each  marginal  frequency  distribution  is  a  unique  representation  of  the 
T-F  image  it  was  generated  from.  The  marginal  frequency  distribution  is  normalized  by 
dividing  the  sums  by  the  largest  sum  in  the  array.  The  normalized  marginal  frequency 
distribution  of  the  Tl(2)  signal,  shown  in  Figure  24,  is  shown  in  Figure  25. 
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Figure  25, 


Frequency  (Hz) 

Normalized  Marginal  Frequency  Distribution  of  the  Tl(2)  Image 
Shown  in  Figure  24, 


The  normalized  distribution  is  used  to  extract  a  threshold  that  is  used  later  to 
isolate  and  crop  the  modulation  energy  within  the  T-F  image.  The  threshold  is  determined 
by  generating  a  histogram  of  100  bins  of  the  normalized  marginal  frequency  distribution 
and  then  taking  the  value  from  the  histogram  bin  which  generates  the  best  probability  of 
correct  classification  (Pec)  results  and  initializing  that  value  as  the  threshold.  An  example 
of  the  Tl(2)  histogram  is  shown  in  Figure  26. 
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Figure  26, 
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Histogram  of  the  Normalized  Marginal  Frequency  Distribution  (Tl) 
Used  to  Determine  Threshold  Autonomously, 


Once  the  threshold  is  determined,  the  eonvolution  of  the  averaging  kernel  {n  =  9) 
and  the  normalized  marginal  frequeney  distribution  is  used  to  determine  the  start  and  stop 
loeation  of  the  modulation  energy.  The  eonvolution  operation  ealeulates  the  mean  of  the 
corresponding  cells  in  the  normalized  distribution  and  eompares  it  to  the  threshold 
identified  from  the  histogram.  If  the  average  of  the  eonvolution  is  greater  than  the 
threshold,  the  start  of  the  modulation  energy  is  found.  To  find  the  stop  loeation  the  same 
eonvolution  algorithm  is  used  but  the  kernel  is  initialized  at  the  end  of  the  normalized 
distribution.  With  the  loeation  of  the  modulation  energy  known,  it  ean  be  eropped  from 
the  T-F  image. 

2,  Autonomous  Cropping 

After  the  loeation  of  the  signal  modulation  energy  is  identified,  the  information  is 
used  to  autonomously  erop  the  modulation  pixels  from  the  original  image  shown  in 
Figure  27(a)  to  form  the  new  image  shown  in  Figure  27(b). 
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(a)  (b) 

Figure  27.  Autonomous  Cropping  Showing  (a)  Original  Resized  Image  and  (b) 

Cropped  Image, 

3,  Final  Image  Resize 

The  binarized  image  is  resized  to  N\xN'^  by  low  pass  filtering,  resampling  and 

then  applying  a  bilinear  interpolation.  The  low  pass  filter  is  used  to  reduee  the  effeet  of 
Moire’  patterns  and  ripple  patterns  that  result  from  aliasing  during  the  resampling 
operation  [21],  The  N\xN\  image  is  then  eonverted  into  a  feature  vector  of  size 

N\xN\x\  for  proeessing  by  the  multi-layer  perceptron  classifieation  network  where 
N\=N\=5Q. 

C.  FAST  FOURIER  TRANSFORM  (FFT)  IMAGE  FILTERING 

The  fast  Fourier  transform  (FFT)  is  a  powerful  variation  of  the  Fourier  transform 
beeause  of  its  ability  to  be  applied  to  algorithms  that  require  real-time  proeessing.  In  an 
operational  environment,  LPI  signals  need  to  be  proeessed  and  elassified  expeditiously. 
Figure  28  shows  the  bloek  diagram  of  the  2D  FFT  proeess.  Before  the  2D  FFT  is  applied 
to  the  image  it  needs  to  be  preproeessed.  Preproeessing  ean  inelude  any  morphologieal 
operations  to  the  image  that  are  needed  to  eontinue  with  the  algorithm.  After  any 
neeessary  preprocessing,  the  2D  FFT  can  be  applied  to  the  image.  The  2D  FFT  is  defined 
as 
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-2  j7r{k^n^+k2n^)l  N 


(4.6) 


N-\  N-\ 

X{k^,kj^)  =  Y^'^x{n^,n^)e 
«1=0  «2=0 

where 

0<^i,^2^A^-1  (4.7) 

The  2D  FFT  is  computed  by  computing  the  2D  FFT  on  all  of  the  rows  and  all  of  the 
columns  of  the  image  being  processed  [23].  The  image  is  then  filtered  in  the  frequency 
domain  with  a  Gaussian  low-pass  filter;  the  Gaussian  low-pass  filter  only  allows  areas  of 
low  frequency  to  pass  and  prevents  high  frequency  noise  from  passing.  The  assumption  is 
that,  in  a  LPI  signal,  the  modulation  energy  is  low  frequency  and  any  noise  would  be  high 
frequency.  The  output  of  the  convolution  should  only  be  the  modulation  energy  of  the 
LPI  signal  in  the  frequency  domain.  The  resulting  image  is  then  taken  back  to  the  time 
domain  with  an  inverse  2D  FFT.  The  resulting  image  shows  the  modulation  energy  of  the 
LPI  signal  [18].  After  the  inverse  2D  FFT  is  applied,  the  image  is  post-processed  with 
any  necessary  morphological  operations  that  might  be  required  to  conclude  the  algorithm. 
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Figure  28,  Theoretical  Fourier  Transform  Processing  [18], 

Figure  29  shows  a  sample  output  out  of  the  fast  Fourier  algorithm  using  a  Tl(2) 
signal.  Figure  29(a)  is  the  Tl(2)  signal.  After  the  2D  Fourier  transform  and  the  Gaussian 
low-pass  filter  with  a  standard  deviation  of  10  were  applied  to  the  signal  (Figure  29(b) 
and  Figure  29(c))  the  inverse  2D  Fourier  transform  was  applied  and  the  output  was  the 
LPI  signal  with  the  modulation  energy  present  and  much  of  the  noise  removed.  Ideally, 
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all  the  noise  would  be  removed  from  the  image  and  the  output  of  the  inverse  2D  FFT 
would  be  an  image  eontaining  only  the  modulation  energy  that  eould  be  used  as  an  input 
as  a  feature  veetor  into  a  elassifieation  network.  Figure  29(d)  eontained  enough  noise  that 
the  image  itself  eould  not  be  used  as  a  feature  veetor  into  a  elassifieation  network.  Post¬ 
processing  actions  would  need  to  be  applied  to  the  image  in  order  for  it  to  be  a  suitable 
input  into  a  classification  network. 

The  Fast  Image  Filtering  technique  can  not  be  used  by  itself  as  an  algorithm  to 
process  an  LPI  signal  for  input  into  a  classification  network.  However,  this  algorithm  can 
be  combined  with  any  of  the  other  two  algorithms  presented  in  this  chapter  to  do  so.  The 
Fast  Image  Filtering  technique  can  be  a  tool  to  eliminate  noise  from  the  image  before  any 
of  the  other  algorithms  are  applied. 


(a) 


(c) 

Figure  29,  Sample  LPI  Signal  Output  from  Fourier  Algorithm, 

In  the  next  chapter  the  three  databases  of  signals  are  described.  Three  databases 
were  developed  that  contain  LPI  signals  to  test  the  feature  extraction  algorithms  and 
classification  networks  presented  in  this  thesis. 
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V.  DATABASE  DESCRIPTION 


The  database  used  in  the  deteetion,  feature-extraetion,  and  elassifieation  proeess 
of  LPI  signals  is  an  important  point  to  eonsider  when  attempting  to  generate  results  that 
ean  emulate  the  results  from  an  operational  environment.  Classifieation  results  will  be 
more  aeeurate  if  the  database  of  LPI  signals  resembles  signals  found  in  the  real-world. 

Three  databases,  generated  by  Professor  Phillip  Pace  from  the  Naval  Postgraduate 
School,  are  investigated  in  this  thesis.  The  first  database  consists  of  LPI  signal 
modulations  at  a  single  carrier  frequency  of  1  kHz  (BPSK,  FMCW,  Frank,  P4,  Tl(2)).  To 
train  the  classification  network  56  signals  were  used.  Twenty  signals  with  modulation 
variations  and  90  signals  with  noise  variations  (SNR  =  1,  2,  3,  -1,  -2)  were  used  to  test 
the  classification  network.  A  second,  more  diverse,  database  was  generated  that  contained 
signals  at  two  different  carrier  frequencies  (1  kHz  and  2  kHz).  From  this  database  144 
signals  were  used  in  the  training  of  the  classification  network.  To  test  the  classification 
network  46  signals  with  modulation  variations  and  180  signals  with  noise  variations 
(SNR  =  1,  2,  3,  -1,  -2)  were  used.  Table  4  illustrates  the  modulation  parameters  for  the 
first  and  second  database.  In  the  table,  the  column  that  describes  the  original  parameters 
of  the  signals  is  symbolic  of  the  signals  used  to  train  the  classification  networks  and  the 
column  that  describes  variation  is  symbolic  of  the  signals  used  to  test  the  classification 
networks.  A  database  that  contains  signals  at  multiple  carrier  frequencies  is  one  step 
closer  to  generating  a  database  that  mimics  the  operational  environment. 
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Table  4,  Second  Database  Used  for  Detection/Feature  Extraction/Classification 


SIGNAL 

Original 

Parameters 

Variation  in 
Modulation 
Parameters 

Description  of 
Modulation 

Parameters 

BPSK 

cpp(Hz) 

1,4,7 

2,3,5,6 

Carrier  cycles  per  subcode 

Nc 

7,11 

7,11 

Number  of  subcodes 

r^(kHz) 

1,2 

1.2 

Carrier  frequency* 

FMCW 

AF(Hz) 

250,500 

350,450 

M  0  dulation  b  andwidth 

(msec) 

20,50 

35,45 

M  0  dulation  p  erio  d 

4  (kHz) 

1.2 

1.2 

Carrier  frequency* 

FRANK 

cpp(Hz) 

1,4,7 

2,3,5,6 

Carrier  cycles  per  subcode 

Nc 

16 

16 

Number  of  subcodes 

f^(kHz) 

1,2 

1.2 

Carrier  frequency* 

E4 

cpp(Hz) 

1,4,7 

2,3,5,6 

Carrier  cycles  per  subcode 

Nc 

16 

16 

Number  of  subcodes 

4  (kHz) 

1,2 

1,2 

Carrier  frequency* 

11 

n 

2,6 

3,4,5 

Number  of  phase  states 

A 

4 

4 

Number  of  code  segments 

4  (kHz) 

1,2 

1,2 

Carrier  frequency* 

The  third  database  was  the  most  diverse  of  the  three.  It  contained  signals  at  two 
different  carrier  frequencies  (1  kHz  and  2  kHz)  with  multiple  SNRs  (SNR  =  -10  dB  to  10 
dB).  To  train  the  classification  network,  439  signals  were  used  and  to  test  the 
classification  network,  638  signals  were  used.  Table  5  illustrates  the  modulation 
parameters  for  the  third  database.  This  database  mimics  the  operational  environment  even 
closer,  and  also  provides  the  most  complex  database  of  the  three  presented  to  test  the 
autonomous  feature  extraction  algorithms  discussed  in  this  thesis.  It  contains  BPSK, 
FMCW,  Frank,  PI,  P2,  P3,  P4,  TI(2),  and  T2(2)  signals. 
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Table  5,  Third  Database  Used  for  Detection/Feature  Extraction/Classification 


SIGNAL 

Original 

Parameters 

Variation  ri 
Modulation 
Parameters 

Description  of 
Modulation 

Parameters 

BPSK 

cppiHz) 

1,4,7 

3,5 

Carrier  cycles  per  subcode 

Nc 

7,11 

7,11 

Number  of  subcodes 

4  (kHz) 

1,2 

1,2 

Carrier  frequency* 

FMCW 

AF(Hz) 

250,500 

350,450 

M  0  dulation  b  andwidth 

tm  (msec) 

20,50 

35,45 

M  0  dulation  p  erio  d 

4  (kHz) 

1,2 

1,2 

Carrier  frequency* 

FRANK 

cpp  (Hz') 

1,4,7 

3,5 

Carrier  cycles  per  subcode 

f^c 

16 

16 

Number  of  subcodes 

4  (kHz) 

1,2 

1,2 

Carrier  frequency* 

P1-P4 

cpp  (Hz) 

1,4,7 

3,5 

Carrier  cycles  per  subcode 

A4 

16 

16 

Number  of  subcodes 

4  (kHz) 

1,2 

1,2 

Carrier  frequency* 

T1,  T2 

n 

2,6 

3,5 

Number  of  phase  states 

k 

4 

4 

Number  of  code  segments 

4  (kHz) 

1,2 

1,2 

Carrier  frequency* 

The  next  chapter  describes  the  two  classification  networks  used  (MLP  and  RBF) 
to  classify  the  different  LPI  signals  after  they  have  been  processed  by  the  feature 
extraction  algorithms. 
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VI.  CLASSIFICATION 


A,  MULTI-LAYER  PERCEPTRON  (MLP) 

To  classify  the  signal  modulations,  a  multi-layer  perceptron  was  used  with  2 
hidden  layers  and  an  output  layer  as  shown  in  Figure  30.  Hidden  layer  one  contained  Ni 
neurons  and  hidden  layer  two  contained  N2  neurons.  Each  neuron  contained  an  activation 
function  which  could  be  logsig  (l/l  +  e  "),  tansig  (2/1-l-e^^" -1),  or  purelin  (n).  The 
output  layer  contained  No  neurons  (one  for  each  modulation). 


Hidden  Layer  1  Hidden  Layer  2  Output  Layer 


Figure  30,  Three-layer  Perceptron  Used  for  Classification, 

MLPs  are  capable  of  quickly  learning  nonlinear  functions  however  they  may 
exhibit  poor  generalization  ability  [24].  Therefore,  The  MLP  used  for  classification  to  test 
the  feature  extraction  algorithms  used  an  improved  generalization  using  regularization  R 

R  =  aMSE  +  {\-a)MSW  (6.1) 

where  a  is  the  performance  parameter,  MSE  is  the  mean  square  error  between  desired  and 
network  generated  output,  and  MSW  is  the  mean  sum  of  squares  of  the  network  weights 
and  biases.  The  following  are  characteristics  of  the  MLP  used  to  classify  and  test  the 
feature  extraction  algorithms  of  this  thesis: 

•  Hidden  unit  representations  of  MLP  depend  on  weighted  linear  summations  of 
inputs  transformed  by  monotonic  activation  functions. 
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•  Activation  of  hidden  unit  is  constant  on  surfaces  consisting  of  1-D  hyperplanes  on 
2-D  input  space. 

•  Distributed  representation  in  aetivation  spaee. 

•  Many  layers  of  weights  and  complex  pattern  conneetivity. 

•  All  parameters  in  MLP  determined  at  same  time  in  a  single  global  (non-linear) 
training  strategy  involving  supervised  learning. 

B,  RADIAL  BASIS  FUNCTION  (RBF) 

The  Radial  Basis  Funetion  (RBF)  is  the  other  elassification  network  used  to 
classify  the  different  signal  modulations.  A  RBF  network  usually  consists  of  three  layers, 
as  shown  in  Figure  31.  The  first  layer  is  the  input  layer  and  is  made  up  of  source  nodes. 
The  seeond  layer  is  a  hidden  layer  of  high  dimension,  providing  a  set  of  funetions  that 
eonstitute  an  arbitrary  basis  for  the  inputs  when  they  are  expanded  into  the  hidden-unit 
spaee.  These  funetions  are  ealled  the  radial  basis  funetions.  The  output  layer  supplies  the 
response  of  the  network  to  the  aetivation  patterns  applied  to  the  input  layer  [25]. 


Figure  31.  RBF  Used  For  Classification  Showing  Input,  Hidden,  and  Output 

Layer. 
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In  the  RBF,  the  relationship  between  the  input  and  output  is  given  by 

N 

f{x)  =  Y,0>nM^-Cn\\)  (6-2) 

n=\ 

where  <l>n{\\x-c^  ||)  is  the  Euclidean  distance  of  the  input  vector  x  from  a  center  .  The 
vectors  c^,{n  =  I,  N),  are  referred  to  as  the  centres  of  the  basis  functions  and  co^  {n  = 
1,  N)  are  the  synaptic  weights  [25,  26].  In  this  thesis,  the  Gaussian  form  of  the  RBF 
was  used.  In  the  Gaussian  form 

=  (6.3) 

to  give 

N  Hk-c„lP 

/(x)  =  ^(y„e  (6.4) 

n=l 

The  Gaussian  form  contains  the  variable  for  spread  ( cr ),  or  the  width  parameter, 
which  is  used  in  Chapter  VII  to  optimize  the  RBF  network. 

The  characteristics  of  the  RBF  used  to  classify  and  test  the  feature  extraction 
algorithms  of  this  thesis  are; 

•  Hidden  units  in  RBF  network  use  distance  vector  between  input  and  basis 
function  centers  followed  by  transformation  with  localized  function. 

•  Activation  of  basis  function  is  a  constant  ID  hyperellipsoids  in  2D  input  space. 

•  Focalized  basis  (Gaussian)  functions  form  representation  in  activation  space  that 
is  local  with  respect  to  input  space. 

•  Simple  architecture  consisting  of  two  layers: 

o  First  layer;  Parameters  of  basis  function, 
o  Second  layer;  Finear  combinations  of  basis  function  activations. 

•  Trained  in  two  stages: 

o  Basis  functions  determined  by  unsupervised  techniques  using  input  data. 


49 


o  Second  layer  weights  found  by  fast  linear  supervised  method. 

•  Best  spread  (or  width)  parameter  <7  is  determined  in  training. 

•  Training  is  fast  and  efficient. 

In  the  next  chapter  an  investigation  of  the  MLP  and  RBF  is  done.  The  MLP  is 
optimized  as  a  function  of  the  number  of  neurons  in  the  hidden  layers,  activation 
function,  and  performance  goal.  The  RBF  is  optimized  as  a  function  of  the  spread  value, 
<7 .  Classification  results  for  the  different  settings  of  the  classification  networks  are 
presented. 
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VII.  SIMULATION  RESULTS 


In  this  chapter,  classification  results  are  presented  for  the  EDAD  and  MFAB 
feature  extraetion  algorithms.  The  two  algorithms  were  exeeuted  using  a  eombination  of 
the  different  databases  and  classifieation  networks  in  an  effort  to  produee  optimum 
results.  Results  are  presented  in  Seetion  A  for  the  EDAB  algorithm  using  the  first 
database  and  the  MEP  elassification  network.  Note  that  the  first  database  consisted  of 
signals  only  at  one  carrier  frequency.  When  this  algorithm  was  applied  to  the  second 
database  that  eontained  multiple  carrier  frequeneies,  the  extension  gave  poor  results.  The 
poor  results  inspired  the  development  of  the  MFAB  algorithm.  This  algorithm  is  capable 
of  proeessing  the  more  eomplicated  databases  (database  2  and  database  3).  Seetion  B.l 
presents  results  for  the  MFAB  algorithm  elassified  by  the  MEP  using  the  second  database 
and  section  B.2  presents  results  for  the  MFAB  algorithm  elassified  by  the  MEP  with  the 
third  database.  Seetion  C.l  eontains  results  for  the  MFAB  algorithm  classified  by  the 
RBF  using  the  second  database  and  section  C.2  contains  results  for  the  MFAB  algorithm 
elassified  by  the  RBF  using  the  third  database.  Section  D  contains  the  results  from  a  SNR 
study  done  with  the  third  database. 

A,  EDAB  CLASSIFICATION  RESULTS  WITH  MLP 

1.  Database  1 

The  output  of  the  neural  network  is  a  eonfusion  matrix  which  indicates  the 
probability  of  correct  classification.  The  confusion  matrix  is  commonly  used  to  report 
results  of  classification  experiments.  In  a  confusion  matrix  of  i  rows  and  j  columns  the 
entry  in  row  i,  column  j  records  the  number  of  times  that  an  object  labeled  to  be  truly  of 
class  i  was  classified  as  class  j.  The  confusion  matrix  diagonal,  where  /=/,  indicates  the 
sueeesses  [27].  Included  are  the  testing  results  shown  for  both  the  Wigner-Ville 
modulation  tests  and  the  signal  plus  noise  tests.  Figure  32  shows  the  elassification  results 
for  cdf  threshold,  C  =  0.8  and  Figure  33  shows  the  results  for  C  =  0.9.  The  test  results 
show  that  inereasing  the  cdf  threshold  from  0.8  to  0.9  within  the  adaptive  binarization 
algorithm  gave  poorer  classification  results  in  all  cases  except  the  BPSK  signal. 

The  following  is  a  list  deseribing  the  settings  of  the  MEP  used  to  generate  the 
results  in  Figure  32  and  Figure  33; 
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•  5000  epochs 

•  Error  Goal  of  50e-6 

•  A^j  =  30  neurons  first  layer 

•  =30  neurons  second  layer 

•  =5  neurons  output  layer 
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Figure  32,  Classification  Results  Showing  C  =  0,8  (Database  1), 
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Figure  33,  Classification  Results  Showing  C  =  0,9  (Database  1), 


It  is  important  to  note  that  the  first  algorithm  extracted  the  modulation  energy 
from  LPI  signals  from  a  database  of  signals  that  consisted  of  only  one  carrier  frequency 
and  when  the  algorithm  was  applied  to  a  database  with  multiple  carrier  frequencies  the 
extension  gave  poor  results. 

B,  MFAB  CLASSIFICATION  RESULTS  WITH  MLP 

To  optimize  classification  with  the  MFAB  algorithm  it  was  necessary  to  pick  an 
accurate  threshold  from  the  histogram  derived  from  the  marginal  frequency  distribution 
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in  order  to  find  the  start  and  stop  frequeneies  of  the  modulation  energy.  In  order  to  do  so 
a  loop  that  eyeled  through  eaeh  of  the  histogram  bins  was  used  to  determine  the  bin  that 
gives  the  best  threshold  for  optimum  elassifieation.  Onee  the  bin  that  gave  the  threshold 
that  produeed  optimum  elassifieation  was  known  the  elassifieation  results  were  produeed. 
Note  that  the  bins  that  produced  optimum  classification  for  the  second  database  were  the 
same  bins  that  were  used  for  classification  with  the  third  database.  The  optimum  bin  is 
related  to  the  feature  extraction  algorithm  and  not  to  the  database  of  signals.  That  is  why 
it  is  acceptable  to  assume  that  the  bin  that  produced  optimum  classification  with  the 
second  database  would  also  produce  optimum  classification  for  the  third  database. 
Section  B.2  contains  the  optimization  tables  that  were  used  to  determine  the  bin  that 
corresponds  with  the  threshold  that  produced  the  best  classification  results. 

The  following  is  a  list  describing  the  settings  of  the  MLP  used  to  generate  the 
results  for  the  second  database; 

•  5000  epochs 

•  Error  Goal  of  le-6 

•  =  35  neurons  in  the  first  layer  and  N2  =  35  neurons  in  the  second  layer  for  the 

Choi-Williams  and  Wigner-Ville  distributions 

•  =  20  neurons  in  the  first  layer  and  N2  =35  neurons  in  the  second  layer  for  the 

QMFB  distribution 

•  =  5  neurons  output  layer 

1.  Database  2 

Optimum  classification  for  the  Choi-Williams  distribution  occurred  when  bin  16 
was  used  as  shown  in  Figures  34  (testing  with  modulation  variation)  and  35  (testing  with 
noise  variation).  No  classification  results  were  obtained  using  thresholds  from  histogram 
bins  greater  than  72  because  the  feature  extraction  algorithm  could  not  isolate  the 
modulation. 
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Figure  34, 


Figure  35, 


Choi-Williams  Optimization  Table  (Test  Modulation), 


HidOQram  Bins 


Choi-Williams  Optimization  Table  (Test  Noise), 


Figure  36  shows  the  classification  results  in  the  form  of  a  confusion  matrix  for  the 
Choi-Williams  distribution.  Classifying  signals  with  variations  in  their  modulation  is  a 
more  difficult  case  than  classifying  signals  with  variations  in  noise.  This  trend  is  present 
in  all  of  the  classification  results. 
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Figure  36,  Choi-Williams  Classification  Confusion  Matrix  (n=16)  (Database  2), 
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Figure  37  and  Figure  38  are  the  optimization  tables  for  the  Wigner-Ville 
distribution.  Optimum  classification  occurs  when  bin  31  (n=31)  is  used.  No  classification 
results  were  obtained  using  thresholds  from  histogram  bins  greater  than  66  because  the 
feature  extraction  algorithm  could  not  isolate  the  modulation. 


Figure  37,  Wigner-Ville  Optimization  Table  (Test  Modulation), 


Figure  38,  Wigner-Ville  Optimization  Table  (Test  Noise), 


Figure  39  is  the  classification  results  for  the  Wigner-Ville  distribution  when  bin 
3 1  is  used. 
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Figure  39,  Wigner-Ville  Classification  Confusion  Matrix  («=31)  (Database  2), 


Figure  40  and  Figure  41  are  the  optimization  tables  for  the  QMFB  distribution. 
Optimum  classification  occurs  when  bin  9  (n=9)  is  used.  No  classification  results  were 
obtained  using  thresholds  from  histogram  bins  greater  than  18  because  the  feature 
extraction  algorithm  could  not  isolate  the  modulation. 


Histogram  Bins 


Figure  40,  QMFB  Optimization  Table  (Test  Modulation), 
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Figure  41,  QMFB  Optimization  Table  (Test  Noise), 

Figure  42  is  the  classification  results  for  the  QMFB  distribution  when  bin  9  is 


used. 
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Figure  42,  QMFB  Classification  Confusion  Matrix  («=9)  (Database  3), 

2,  Database  3 

In  order  to  improve  classification  results  the  MLP  was  optimized.  The  MLP  was 
optimized  by  generating  classification  results  by  varying  activation  functions,  the  number 
of  neurons  in  each  of  the  hidden  layers,  and  the  performance  goal.  The  following 
activation  functions  were  tested;  logsig,  transig,  and  purelin.  For  each  activation  function 
the  number  of  neurons  was  varied  from,  in  the  first  hidden  layer,  35  and  45  neurons,  and 
in  the  second  hidden  layer,  25,  35,  and  45  neurons.  Classification  results  presented  for  the 
third  database  were  computed  with  the  optimized  MLP.  Figure  43  is  a  plot  for  the  percent 
correct  classification  (Pec)  for  each  of  the  15  different  configurations  of  the  MLP  tested. 
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Table  6  outlines  the  specific  settings  of  each  of  the  15  iterations  that  were  tested  for  the 
multi-layer  perceptron.  Combination  8  was  determined  to  produce  optimum  results. 


Table  6.  MLP  Optimization  Settings 
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Figure  43,  MLP  Optimization  Table, 
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The  following  are  the  settings  that  correspond  with  Combination  8  in  Figure  43; 


•  logsig  for  each  of  the  three  activation  functions 

•  =  45  neurons  in  the  first  hidden  layer 

•  A^2  ~  45  neurons  in  the  second  hidden  layer 

•  =5  neurons  output  layer 

•  Error  goal  of  1 . 1  e-6 

Figure  44,  Figure  45,  and  Figure  46  are  the  classification  results  for  the  third 
database  with  the  corresponding  optimized  bin. 
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Figure  44,  Choi-Williams  Classification  Confusion  Matrix  («=16)  (Database  3), 


Test  Modulation  CM 

BPSK 

FMCW 

FRANK 

PI 

P2 

P3 

P4 

T1 

T2 

BPSK 

0.62 

0.02 

0.16 

0.08 

0.11 

0.13 

0.11 

0.35 

0.31 

FMCW 

0.03 

0.87 

0.08 

0.04 

0.05 

0.09 

0.08 

0.06 

0.05 

.FRANK 

0.07 

0.01 

0.39 

0.21 

0.14 

0.15 

0.20 

0.06 

0.05 

PI 

0.04 

0.01 

0.06 

0.33 

0.08 

0.08 

0.05 

0.10 

0.10 

P2 

0.08 

0.03 

0.08 

0.09 

0.51 

0.08 

0.05 

0.13 

0.09 

P3 

0.03 

0.03 

0.06 

0.13 

0.01 

0.34 

0.13 

0.04 

0.05 

iP4 

0.03 

0.03 

0.13 

0.14 

0.04 

0.11 

0.38 

0.15 

0.21 

.T1 

0.08 

0.01 

0.00 

0.00 

0.05 

0.03 

0.00 

0.06 

0.05 

T2 

0.03 

0.00 

0.05 

0.00 

0.01 

0.01 

0.01 

0.05 

0.09 

Figure  45,  Wigner-Ville  Classification  Confusion  Matrix  («=31)  (Database  3), 
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Figure  46,  QMFB  Classification  Confusion  Matrix  («=9)  (Database  3), 
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c. 


MFAB  CLASSIFICATION  RESULTS  WITH  RBF 

To  produce  optimum  results  with  the  RBF  it  was  necessary  to  pick  an  accurate 


threshold  from  the  histogram  derived  from  the  marginal  frequency  distribution  in  order  to 
accurately  find  the  start  and  stop  frequencies  of  the  modulation  energy  just  like  was  done 
for  the  MLP.  Section  C.2  contains  the  optimization  tables  that  were  used  to  determine  the 
bin  that  corresponds  with  the  threshold  that  produced  the  best  classification  results. 

1.  Database  2 

Figure  47  and  Figure  48  are  the  optimization  tables  for  the  Choi-Williams 
distribution.  Optimum  classification  occurs  when  bin  16  (n=16)  is  used. 


Figure  47, 


Histoaram  Bins 


Choi-Williams  Optimization  Table  (Test  Modulation), 
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Figure  48,  Choi-Williams  Optimization  Table  (Test  Noise), 


Figure  49  is  the  classification  results  for  the  Choi-Williams  distribution  when  bin 
16  is  used. 
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Figure  49,  Choi-Williams  Classification  Confusion  Matrix  (n=16)  (Database  2), 


Figure  50  and  Figure  51  are  the  optimization  tables  for  the  Wigner-Ville 
distribution.  Optimum  classification  occurs  when  bin  58  (n=58)  is  used. 


Figure  50,  Wigner-Ville  Optimization  Table  (Test  Modulation), 


Figure  51, 


Wigner-Ville  Optimization  Table  (Test  Noise), 
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Figure  52  is  the  classification  results  for  the  Choi-Williams  distribution  when  bin 
58  is  used. 
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Figure  52,  Wigner-Ville  Classification  Confusion  Matrix  («=58)  (Database  2), 

Figure  53  and  Figure  54  are  the  optimization  tables  for  the  QMFB  distribution. 
Optimum  classification  occurs  when  bin  14  (n=14)  is  used. 


Histogram  Bins 


Figure  53,  QMFB  Optimization  Table  (Test  Modulation), 
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Histoqram  Bins 


Figure  54,  QMFB  Optimization  Table  (Test  Noise), 

Figure  55  is  the  classification  results  for  the  QMFB  distribution  when  bin  14  is 


used. 
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Figure  55,  QMFB  Classification  Confusion  Matrix  («=14)  (Database  2), 

2,  Database  3 

The  RBF  was  optimized  similar  to  how  the  MLP  was  optimized.  The  RBF  was 
optimized  by  varying  the  spread  parameter.  Each  of  the  three  different  distributions  had  a 
unique  spread  value  that  produced  optimum  classification.  Unlike  the  MLP,  each  of  the 
different  distributions  has  a  unique  setting  for  the  RBF  to  produce  optimum  results;  the 
MLP  had  one  optimum  setting  that  applied  to  all  three  distributions.  Ligure  56,  Ligure  57, 
and  Ligure  58  are  the  optimization  tables  used  to  determine  the  best  spread  value  for  each 
of  the  three  different  distributions.  Lor  the  Choi-Williams  distribution  the  optimum 
spread  value  was  6,  cr  =  6  .  Lor  the  Wigner-Ville  distribution  the  optimum  spread  value 
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Pcc 


was  7,  (7  =  1 .  For  the  QMFB  approach  the  optimum  spread  value  was  2,  a  =  2.  Figure 
59,  Figure  60,  and  Figure  61  are  the  results  for  the  optimized  RBF. 


Spread 


Spread 

Figure  57,  RBF  Optimization  Table  (Wigner-Ville), 
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Figure  58.  RBF  Optimization  Table  (QMFB), 
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Figure  59,  Choi-Williams  Classification  Confusion  Matrix  (<t  =  6)  (Database  3), 
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Figure  60, 


Wigner-Ville  Classification  Confusion  Matrix  ( cr  =  7)  (Database  3), 
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D.  SNR  STUDY 

1,  Database  3 

A  study  was  done  with  the  third  database  to  examine  the  Pec  versus  individual 
SNRs.  Each  SNR  for  a  LPI  signal  is  directly  related  to  a  range  it  can  be  detected  by  an 
intercept  receiver.  The  SNR  results  give  an  indication  of  how  close  in  range  the  emitter 
must  be  to  achieve  a  given  Pec.  Figure  62,  Figure  63,  and  Figure  64  show  how  each  of 
the  SNRs  performed  for  the  three  distributions  described  in  this  thesis  for  the  variation  in 
modulation.  For  the  Choi-Williams  distribution  (Figure  62),  the  best  classification  results 
were  achieved  when  a  SNR  of  -1  was  used.  For  the  Wigner-Ville  distribution  (Figure  63), 
the  best  classification  results  were  achieved  when  a  SNR  of  5  was  used.  For  the  QMFB 
approach  (Figure  64),  the  best  classification  results  were  achieved  when  a  SNR  of  3  was 
used. 
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VIII.  CONCLUSIONS  AND  RECOMMENDATIONS 


A.  CONCLUSIONS 

1.  Feature  Extraction  Algorithms 

The  EDAB  process  was  the  first  algorithm  tested.  The  algorithm  proved  to  be 
successful  only  when  the  algorithm  was  applied  to  a  database  of  signals  that  contained 
only  one  carrier  frequency.  When  the  algorithm  was  applied  to  a  database  that  contained 
signals  at  two  carrier  frequencies  it  did  not  perform  well.  The  combination  of  multiple 
carrier  frequencies  in  instances  with  high  SNRs  confused  the  algorithm;  it  could  not 
isolate  the  modulation’s  carrier  frequency.  Morphological  operations  have  a  lot  of 
potential  in  terms  of  processing  LPI  signals  and  can  be  extended  to  a  more  diverse 
database  of  LPI  signals  if  the  correct  combinations  of  morphological  operations  are 
applied. 

The  MFAB  process  was  the  second  and  most  successful  algorithm.  It  was  able  to 
be  applied  to  a  complex  database  of  LPI  signals  that  closely  resembled  the  types  of 
signals  that  are  found  operationally  and  produce  promising  results.  Part  of  the  MFAB 
algorithm’s  success  was  the  user’s  ability  to  choose  a  comparator  threshold  from  an 
optimization  table.  Choosing  an  optimum  threshold  ensured  that  the  algorithm  was  able 
to  isolate  the  modulation  energy  and  produce  best  possible  results. 

The  Fast  Image  Filtering  algorithm  was  successful  not  because  it  was  able  to 
extract  the  modulation  energy  from  a  LPI  signal  autonomously  but  because  it  established 
itself  as  a  technique  that  can  be  implemented  with  the  EDAB  and  MFAB  algorithms  to 
reduce  noise  in  a  LPI  signal.  Minimizing  noise  in  a  LPI  signal  simplifies  the  feature 
extraction  process. 

2,  Classification  Results 

In  terms  of  classification,  the  best  results  were  produced  with  the  Choi-Williams 
distribution.  The  success  of  the  Choi-Williams  distribution  can  be  attributed  to  its  lack  of 
cross  terms.  The  Wigner-Ville  distribution  has  large  cross-terms  which  can  confuse  the 
classification  networks.  Large  cross-terms  are  not  conducive  to  producing  unique  features 
that  can  distinguish  the  different  signals  from  one  another. 
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The  MLP  consistently  produced  better  results  than  the  RBF.  The  MLP  was 
successful  because  it  had  more  variables  that  could  be  configured  to  produce  optimum 
results.  The  only  variable  in  the  RBF  that  could  be  changed  was  the  spread.  While  the 
results  from  the  RBF  were  not  as  good  as  those  seen  coming  from  the  MLP  the  RBF  does 
have  an  advantage  in  terms  of  its  application  to  an  operational  environment.  Its  training 
phase  is  fast  and  efficient.  Because  it  trains  faster  than  the  MLP,  in  an  operational 
environment  a  user  would  not  have  to  wait  long  before  receiving  classification  results  for 
a  LPI  signal.  This  feature  of  the  RBF  is  important  and  should  be  investigated  in  an 
attempt  to  improve  the  RBF’s  results  so  that  one  day  it  can  be  applied  operationally. 

3,  Applicability  to  Defense  Applications 

To  counter  the  threat  posed  by  LPI  radars  it  is  necessary  to  develop  an 
autonomous  sequence  that  can  autonomously  detect,  extract  features,  and  classify  LPI 
signals.  Automating  this  sequence  and  emitting  any  human- in-the-loop  participation 
allows  for  war  fighters  operating  globally  to  receive  real-time  intelligence.  The  conflicts 
that  currently  burden  our  country  require  that  all  war  fighters  receive  intelligence 
promptly.  Automating  the  LPI  classification  process  brings  the  war  fighter  one  more 
piece  of  real-time  intelligence  that  can  help  him  safely  and  expeditiously  accomplish  his 
mission. 

B,  RECOMMENDATION  FOR  FUTURE  WORK 

All  of  the  feature  extraction  algorithms  can  be  further  investigated  to  improve 
performance.  The  EDAB  algorithm  introduced  the  idea  of  combining  unique 
morphological  operations  to  extract  the  modulation  energy  from  LPI  signals.  The  EDAB 
algorithm  can  be  applied  to  more  complex  databases  of  EPI  signals  if  the  correct 
combinations  of  morphological  operations  are  used.  The  MFAB  algorithm  was  able  to  be 
applied  to  a  complex  database  of  EPI  signals  and  produce  promising  results.  However, 
the  results  were  not  perfect  and  improving  the  algorithm  to  increase  results  needs  to  be 
examined.  Implementing  the  Past  Image  Piltering  technique  with  the  EDAB  and  MPAB 
algorithms  as  a  step  to  eliminate  noise  in  EPI  signals  needs  to  be  investigated. 

The  classification  networks  were  optimized  in  this  thesis  in  an  attempt  to  improve 
results.  However,  the  optimization  process  can  be  improved  in  order  to  improve  results. 
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Different  aspeets  of  the  networks  ean  be  examined  in  an  attempt  to  eontinue  the 
optimization  proeess. 

The  ultimate  goal  that  motivates  researeh  in  the  field  of  autonomous  T-F  cropping 
and  feature-extraction  algorithms  for  classification  of  LPf  radar  modulations  is  applying 
the  technology  on  to  a  high-speed  processor  that  can  be  embedded  in  a  FLINT  receiver 
that  supports  theatre  operations  globally. 
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